Deep Reinforcement Learning Based Active Queue Management for IoT Networks

نویسندگان

چکیده

Internet of Things (IoT) finds its applications in home, city and industrial settings. Current network is transition to adopt fog/edge architecture for providing the capacity IoT. However, order deal with enormous amount traffic generated by IoT devices reduce queuing delay, novel self-learning management algorithms are required at nodes. Active Queue Management (AQM) a known intelligent packet dropping techique differential QoS. In this paper, we propose new AQM scheme based on Deep Reinforcement Learning (DRL) technique introduce scaling factor our reward function achieve trade-off between delay throughput. We choose Q-Network (DQN) as baseline scheme, compare approach various schemes deploying them interface node. simulated configuring different bandwidth round trip time (RTT) values. The simulation results show that outperforms other terms jitter while maintaining above-average throughput, also verifies DRL efficient managing congestion.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm

: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...

متن کامل

Active Robotic Mapping through Deep Reinforcement Learning

We propose an approach to learning agents for active robotic mapping, where the goal is to map the environment as quickly as possible. The agent learns to map efficiently in simulated environments by receiving rewards corresponding to how fast it constructs an accurate map. In contrast to prior work, this approach learns an exploration policy based on a user-specified prior over environment con...

متن کامل

Edge-based active queue management

In the paper, a new framework of active queue management, namely, edge-based active queue management (EAQM), is proposed. Conventional AQM schemes are required to be deployed at all routers in the network, and this involves significant upgrading to current drop-tail routers. The new approach only needs to modify the edge routers and at the same time provides similar or better performance as com...

متن کامل

Vision-based Deep Reinforcement Learning

Recently, Google Deepmind showcased how Deep learning can be used in conjunction with existing Reinforcement Learning (RL) techniques to play Atari games[11], beat a world-class player [14] in the game of Go and solve complicated riddles [3]. Deep learning has been shown to be successful in extracting useful, nonlinear features from high-dimensional media such as images, text, video and audio [...

متن کامل

Adversarial Active Learning for Deep Networks: a Margin Based Approach

We propose a new active learning strategy designed for deep neural networks. The goal is to minimize the number of data annotation queried from an oracle during training. Previous active learning strategies scalable for deep networks were mostly based on uncertain sample selection. In this work, we focus on examples lying close to the decision boundary. Based on theoretical works on margin theo...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of Network and Systems Management

سال: 2021

ISSN: ['1064-7570', '1573-7705']

DOI: https://doi.org/10.1007/s10922-021-09603-x